[do not merge] base example to showcase new apis #19199

jamiedemaria · 2024-01-12T19:48:57Z

Summary & Motivation

How I Tested These Changes

jamiedemaria · 2024-01-12T19:49:11Z

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

Current dependencies on/for this PR:

master
- PR Only have one kind of context for direct invocation #17554
  - PR duplicate op context methods on asset context #18573
    - PR deprecate methods on AssetExecutionContext that can be found via the DagsterRun object #17339
      - PR Direct invocation asset execution context #18549
        
        PR deprecate asset_partition_*_for_output on AssetExecutionContext #19436
        
        PR [docs] remove asset_partition_*_for_output from docs #19437
        
        PR deprecate op related methods from AssetExecutionContext #19441
        
        PR Make upstream asset materialization events available on the context #18971
        
        PR [wip] store the tags fetched by data versioning so we can use them for upath io manager #19324
        
        PR [UPath I/O managers] special case handling of None outputs #18820
        
        PR Make input partitions methods based on asset key not input name #19027
        
        PR Support partitioned assets for fetching latest AssetMaterializations #19286
        
        PR [do not merge] base example to showcase new apis #19199 👈
        
        PR [prototype] sub-context for each upstream dependency #19283
        
        PR [prototype] AssetExecutionContext partition methods on sub context #19236
        
        PR [prototype] AssetExecutionContext partition methods given as named tuple #19037
        
        PR [prototype] AssetExecutionContext partition methods directly on the context #19032
        
        PR [wip] two execution contexts with minimal changes #18543
        
        PR [wip] see wht needs to change when asset context is no longer an op context #18553
      - PR support Asset and Op ExecutionContexts in standard execution path #17972
        
        PR [wip] add AssetExecutionContext to direct invocation #18044

This stack of pull requests is managed by Graphite.

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 5331a95 to c47a59d Compare January 16, 2024 17:37

jamiedemaria force-pushed the jamie/partition-example-base branch from b0e7745 to 215fed9 Compare January 16, 2024 17:37

jamiedemaria mentioned this pull request Jan 16, 2024

[UPath I/O managers] special case handling of None outputs #18820

Closed

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from c47a59d to 0cd7791 Compare January 16, 2024 18:15

jamiedemaria force-pushed the jamie/partition-example-base branch from 215fed9 to 38b66f9 Compare January 16, 2024 18:15

jamiedemaria mentioned this pull request Jan 16, 2024

[prototype] AssetExecutionContext partition methods on sub context #19236

Closed

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 0cd7791 to fe5fdbf Compare January 17, 2024 21:13

jamiedemaria force-pushed the jamie/partition-example-base branch 2 times, most recently from 50c80ab to 1fee854 Compare January 18, 2024 15:55

This was referenced Jan 18, 2024

[prototype] sub-context for each upstream dependency #19283

Closed

Support partitioned assets for fetching latest AssetMaterializations #19286

Closed

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 0d98e03 to a349b63 Compare January 19, 2024 16:38

jamiedemaria force-pushed the jamie/partition-example-base branch from 1fee854 to 558590d Compare January 19, 2024 16:38

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from a349b63 to b4cf23a Compare January 19, 2024 19:09

jamiedemaria force-pushed the jamie/partition-example-base branch from 558590d to bcc9cab Compare January 19, 2024 19:09

jamiedemaria mentioned this pull request Jan 19, 2024

[wip] store the tags fetched by data versioning so we can use them for upath io manager #19324

Closed

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from b4cf23a to 577ce16 Compare January 19, 2024 20:13

jamiedemaria force-pushed the jamie/partition-example-base branch from bcc9cab to af681dc Compare January 19, 2024 20:13

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 577ce16 to 9c0b95d Compare January 23, 2024 00:11

jamiedemaria force-pushed the jamie/partition-example-base branch from af681dc to 3016287 Compare January 23, 2024 00:11

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 9c0b95d to be3e875 Compare January 26, 2024 19:10

jamiedemaria force-pushed the jamie/partition-example-base branch from 3016287 to 04fd627 Compare January 26, 2024 19:10

This was referenced Jan 26, 2024

deprecate asset_partition_*_for_output on AssetExecutionContext #19436

Merged

[docs] remove asset_partition_*_for_output from docs #19437

Merged

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from be3e875 to 0de310c Compare January 26, 2024 20:05

jamiedemaria force-pushed the jamie/partition-example-base branch from 04fd627 to 0e1fc3e Compare January 26, 2024 20:05

jamiedemaria mentioned this pull request Jan 26, 2024

deprecate op related methods from AssetExecutionContext #19441

Merged

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 0de310c to 16ec6bb Compare January 29, 2024 15:39

jamiedemaria force-pushed the jamie/partition-example-base branch from 0e1fc3e to dc6edf0 Compare January 29, 2024 15:39

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 16ec6bb to 0be42c6 Compare January 29, 2024 16:30

jamiedemaria force-pushed the jamie/partition-example-base branch from dc6edf0 to ccc4260 Compare January 29, 2024 16:30

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 0be42c6 to 845d988 Compare January 29, 2024 17:26

jamiedemaria force-pushed the jamie/partition-example-base branch from ccc4260 to f416c05 Compare January 29, 2024 17:26

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 845d988 to ef9380b Compare January 29, 2024 18:16

jamiedemaria force-pushed the jamie/partition-example-base branch from f416c05 to 51d46aa Compare January 29, 2024 18:16

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from ef9380b to 14211a3 Compare January 29, 2024 19:44

jamiedemaria force-pushed the jamie/partition-example-base branch from 51d46aa to 2670364 Compare January 29, 2024 19:44

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 14211a3 to b2a3b39 Compare January 29, 2024 20:03

jamiedemaria force-pushed the jamie/partition-example-base branch from 2670364 to 2660075 Compare January 29, 2024 20:03

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from b2a3b39 to 2f56390 Compare January 30, 2024 17:23

jamiedemaria force-pushed the jamie/partition-example-base branch from 2660075 to a5828e1 Compare January 30, 2024 17:23

jamiedemaria added 2 commits January 30, 2024 15:18

partition example for api decision

91c92d7

typing

f5be566

jamiedemaria force-pushed the jamie/partition-methods-asset-key-based branch from 2f56390 to d2ab183 Compare January 30, 2024 20:19

jamiedemaria force-pushed the jamie/partition-example-base branch from a5828e1 to f5be566 Compare January 30, 2024 20:19

jamiedemaria closed this Apr 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[do not merge] base example to showcase new apis #19199

[do not merge] base example to showcase new apis #19199

jamiedemaria commented Jan 12, 2024

jamiedemaria commented Jan 12, 2024 •

edited

Loading

[do not merge] base example to showcase new apis #19199

[do not merge] base example to showcase new apis #19199

Conversation

jamiedemaria commented Jan 12, 2024

Summary & Motivation

How I Tested These Changes

jamiedemaria commented Jan 12, 2024 • edited Loading

jamiedemaria commented Jan 12, 2024 •

edited

Loading